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(54) Robust watermarking for digital objects 

(57) Method of embedding a watermark in a digital 
object. The watermark is used to perform argument 
modulation of a transform of the object. Watermark data 
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is used in the argument of the transform to effectively 
shift around values in the transform domain. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention deals with the process of 
watermarking digital objects such as still images, video, 
multimedia, and sound. 

Art Background 

[0002] Watermarks are methods for identification or 
authentication, such as watermarked paper showing a 
logo or design. In the digital arts, watermarking refers to 
processes by which the watermark, identifying or 
authenticating data, is embedded in a digital object, or 
the mark is extracted from a digital object. Watermark- 
ing is used in copyright protection as a means of identi- 
fying ownership and enabling the detection of copies 
and derivatives. 

[0003] In the case of watermarking stifl images, most 
published methods use the watermark to manipulate 
the amplitude of pixel values directly in the pixel domain. 
For example, U.S. Patent 5,530,751 to Morris embeds a 
digital watermark in an object by manipulating the 
amplitude of selected digital samples of the object. This 
approach is also used in U.S. Patent 5,636,292 to 
Rhoads. "Protecting Publicly- Available Images with an 
Invisible Watermark" by Gordon W. Braudaway, IEEE 
International Conference on Image Processing, Santa 
Barbara, Oct. 1997 discloses a method of multiplying 
the amplitude of the image by the watermark. Such sys- 
tems that vary the amplitude of the image are vulnera- 
ble to additive noise, and are also vulnerable to attack. 
Other systems, such as "Adaptive Watermarking in the 
DCT Domain" by Bo Tao & Bradley Dickinson, IEEE 
Conference on ASSP, April 1997; Towards Robust and 
Hidden Image Copyright Labeling" by E. Koch & J. 
Zhao, Proceedings of 1995 IEEE Workshop on Nonlin- 
ear Signal and Image Processing (Neos Marmaras, 
Halkidiki, Greece, June 20-22, 1995), pp. 452-455; and 
"Image Watermarking Using DCT Domain Constraints" 
by A. Bors and I. Pitas, 1996 IEEE International Confer- 
ence on Image Processing (ICIP'96), Lausanne , Swit- 
zerland, vol. Ill, pp. 231-234, 16-19 September 1996, 
disclose techniques for embedding watermarks by 
enforcing constraints on the ordering or differences of 
transform values, typically block Discrete Cosine Trans- 
forms (DCT). While these systems are more resistant to 
noise, they are not resistant to other operations such as 
cropping and scaling as they depend on accurate regis- 
tration with the original image. The method disclosed in 
"Phase Watermarking of Digital Images" by J.J.K. O 
Ruanaidh, W.J. Dowling and F.M. Boland, IEEE Interna- 
tional Conference on Image Processing, Vol. Ill pp. 239- 
241, Lausanne, Switzerland, Sept 1996 hides the 
watermark in the phase of the DCT; the computational 



complexity and numerical errors involved in this 
approach are undesirable, and the phase is extremely 
susceptible to translations of the original image. 
[0004] As noted, methods that include a watermark by 

5 manipulating pixel amplitudes are susceptible to noise 
and are vulnerable to attempts at removal, If the water- 
mark is highly correlated, such as a company logo, it will 
often be visible in the watermarked image. The block 
DCT methods are susceptible to image translations. A 

w watermarking scheme should result in an invisible or 
imperceptible mark even when the watermark itself is 
highly correlated, be difficult to intentionally remove, 
and be robust to common image transformations such 
as compression including lossy compression, JPEG 

is compression, requantization, contrast enhancement, 
brightness variation, conversion to gray scale, bluffing, 
and sharpening. 

SUMMARY OF THE INVENTION 

20 

[0005] In a first embodiment of the present invention, 
watermark information is incorporated in a digital object 
by including the watermark in the argument of a trans- 
form of the image. By using the watermark toperform 

25 argument modulation of the object in the transform 
domain, rather than modifying the amplitude of the 
image, the resulting watermarked image is more robust 
and resistant to attack. A second embodiment of the 
present invention discloses an additional method of 

30 argument modulation. A third embodiment combines 
the watermarking process with lossy compression. In all 
embodiments the argument modulation process results 
in a loss of information, thus making the watermarked 
object less vulnerable to intentional attack. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0006] The present invention is described with respect 
to particular exemplary embodiments thereof and refer- 
40 ence is made to the drawings in which: 

Fig. 1 shows a block diagram of apparatus for 
watermarking digital objects, 

45 Fig. 2 shows an example of argument shifting 
according to the present invention, and 

Fig. 3 shows a block diagram of an apparatus for 
detecting watermarked objects. 

50 

DETAILED DESCRIPTION 

[0007] Robust watermarking of digital objects such as 
images has been suggested as a means of copyright 
55 protection. For robustness the watermark should be 
inserted in a region of perceptual significance, so that 
any damage to the watermark includes damage to the 
perceptual quality of the digital object. For the water- 
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mark to be imperceptible, it should not be in regions of 
great perceptual significance. Selection of suitable 
regions is a process Known to the art. Alternative posi- 
tions of the watermark include placing the watermark at 
a known position within the image, such as in a particu- 5 
lar corner or the center of the image, tiling the water- 
mark across the image or sections of the image, or 
combinations of the above. 

[0008] Where known methods of embedding water- 
marks in digital objects for the most part deal with hiding 10 
watermark information in the amplitude domain, the cur- 
rent invention embeds the watermark information in the 
argument of the transform or frequency domain of the 
image. While the invention is described with respect to 
still images, it is applicable to a range of digital objects, is 
including but not limited to sound, video, and multime- 
dia. 

[0009] The watermark itself for images is a two-dimen- 
sional distribution of intensities. It may be color, gray- 
scale, or binary with increasing robustness. Binary 20 
watermarks are used in the preferred embodiment, the 
watermark being an array of ones and zeroes. The 
watermark may be an unencrypted, unencoded com- 
pany logo, or an encrypted message including error cor- 
rection. These attributes of the watermark depend on 25 
the degree of robustness required, the nature and 
amount of the information to be hidden, and the compu- 
tational complexity to be tolerated in the detection proc- 
ess. 

[001 0] Referring to Fig. 1 for a first embodiment of the 30 
current invention, let f(ij) 110 represent the original 
image. In step 120 F(kJ) is computed, representing the 
transform of image f(i,j). Transform F could be the Dis- 
crete Fourier Transform (DFT), Discrete Cosine Trans- 
form (DCT), or other known transforms such as Walsh, 35 
Hadamard, Discrete Hartley, or Discrete Wavelet trans- 
forms. Let w(k,l) 130 be the watermark to be applied. 
Let g(i,j) 160 be the watermarked image, and G(kJ) 
formed in step 140 the transform of the watermarked 
image. The relationships between the images and their 40 
transforms are: 

f(i.j)<->F(k,l) 
g(i,j)<->G(W) 

45 

[0011] Using methods known to the art, a range of 
parameter values in the transform domain are chosen 
that retain sufficient perceptual information so that 
destroying the watermark will destroy image quality, 
while not being perceptually dominant. For these values so 
a, p, y, and 8 the transform of the watermarked image is: 

G(k,l) = F(k + a x w(k,l) • y, / + p x w(k,t) - 6) 

where a, p, y and 6 provide an affine conversion 55 
between the values of w(k,l) and the values of the cho- 
sen argument shift. Note that the watermark data is 
being applied to the transform of the image, shifting 



image elements from one place in the transform domain 
to another. The original image f(i,j) 110 is transformed 
120 to F(k,l) and watermark w(k,l) 130 used to modulate 
140 F(k,l), the transform, creating the transform of the 
watermarked image, G(k,l). The inverse transform 150 
is applied to G(k,l) producing the watermarked image 
g(i.j)160. 

[0012] This argument modulation process is also 
shown in Fig. 2. In this figure, matrix 210 is the trans- 
form of the image, F(k,l). Matrix 230 is the watermark 
w(k,l), and matrix 260 is the watermarked transform 
G(k,l). Using standard matrix notation, F(1 , 1) = 3, F(1 ,2) 
= 9, F(1,3) = 7 and soon. Using the values a = p = 1 
and y = 6 • 0 , the process of applying the watermark 
shown above simplifies to: 

G(k,l) = F(k + w(k,l), I + w(k,l)) 

and has the effect of shifting elements in the F(k,l) 
matrix 210 wherever the watermark matrix w(k,l) 
230 contains a 1. For example, w(IJ) contains 0, so 
G(l.l) =F(I.I) o 3 . But w(2,2) =1, so G(2,2) = 
F(2+w(2,2) , 2+w(2,2)) = F(3,3) = 7 . Likewise G(2, 3) 
= F(2+w(2,3) , 3+w(2,3)) = F(3,4) = 3 . The shifted val- 
ues in matrix G(k,l) 260 are shown in bold. With the val- 
ues given, watermark elements equal to 1 have the 
effect of shifting values in the transform up and to the 
left. 

[0013] This process of argument modulation is com- 
putationally very efficient, and may be implemented in 
software or hardware. Since it is not a linear, additive 
process, shifting elements in the transform domain 
rather than adding a value to elements in either the 
image or transform domain, it is not susceptible to 
attacks common to to liner and additive systems, nor 
does the resulting watermark deteriorate under com- 
mon operations such as compression, requantizing, 
enhancement blurring, and sharpening. 
[0014] A distinct watermark may be used for each of 
the k,l directions, reducing redundancy and robustness, 
but increasing information content. Given a second 
watermark z(kj) the process of watermarking becomes: 

G(k,l) = F(k + a,x w(k,l) - y, /+ p x z(k,l) - 8) 

[001 5] For watermarking color images, the watermark 
may be inserted in one or more of the elements of the 
color space for the image. For example, rf an image is 
processed in an RGB color space, separating it into red. 
green, and blue elements, the watermark is applied to 
one or more of these elements. Similarly, if the color 
image is processed in a luminance - chrominance 
space, the watermark is applied to one or both of the 
chrominance or luminance elements. While in these 
cases it is possible to apply the watermark to one or 
more of the possible elements, or to apply different 
watermarks to each element, thereby increasing infor- 
mation content, this reduces redundancy and robust- 
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ness as noted previously, and may in some 
circumstances produce more perceptible differences in 
the resulting watermarked image. For each chosen ele- 
ment, the transform is applied and the watermark 
applied in the transform domain as previously 5 
described. The inverse transform is applied producing 
the watermarked element. 

[001 6] A second embodiment of the present invention 
uses an additional key to select the direction of shift per- 
formed during the process of argument modulation. In 10 
this embodiment of the invention the watermark is 
added into the transform domain of the image according 
to: 

G(k,l) = F(k + / + X t ) 15 

where 

X k = +/- (a x w(k,l) + y) 

20 

A. , = +/- (a x w(k,f) + y) 

depending in some manner on F(k,l), for example 
choosing + if the i* bit of F(k,l) is a 1 , and choosing - if 
the i m bit of F(kJ) is a zero. 25 
[001 7] A third embodiment of the invention applies to 
watermarking digital objects during compression. Lossy 
compression schemes for digital images such as JPEG 
or MPEG, and digital sound typically perform the follow- 
ing steps: 30 

(1) Transform the object 

(2) Quantize the transform coefficients 

(3) Encode the quantized transform coefficients. 

35 

[0018] In image compression, the block Discrete 
Cosine Transform (OCT) is commonly used. After the 
DCT is performed, the resulting coefficients are quan- 
tized as is known in the art. This quantization step intro- 
duces loss, and allows the encoding process, usually 40 
using run length codes) Huffman codes, or other com- 
pression technology, to greatly reduce the amount of 
storage required for the image. 

[0019] In sound compression, a similar process is 
used, with a transform being applied to the digitized 45 
sound stream, quantization applied to the transform 
coefficients, and the results encoded. The quantization 
may be a simple process, or may be a complex process 
relying on an analysis of the human auditory system, 
such as the ATRAC process used in mini-discs. so 
[0020] For digital objects subject to lossy compres- 
sion, watermarking according to the present invention 
may be applied as part of the overall compression proc- 
ess. The transform is applied to the object, and the 
watermark may be applied either before or after the 55 
quantization step. After the watermark is applied the 
encoding process is applied. As in other embodiments 
of the present invention, this may be accomplished 



using software controlling a standard processor, soft- 
ware controlling a specialized processor such as a dig- 
ital signal processor (DSP), or by custom hardware. 
[0021 ] Watermark detection is performed as shown in 
Fig. 3 using the original digital image f(i.j) 310 and can- 
didate image i(i,j) 330. The transform F(k,l) of the origi- 
nal image is computed 320, as is the transform l(kj) of 
the candidate image, 340. The transformed candidate 
image l(k,l) over the likely range of arguments a, p, y, 
and 6 as described above in the encoding process are 
compared 350 to the values F(k,l) of the transform of the 
original image for possible values of the watermark 
w'(k,l) 360. The value of w'(k,l) that provides the least 
error is chosen. 

[0022] In making this comparison between the trans- 
formed candidate image and the transformed original 
image for a particular set of parameters a, p, y, and 5, a 
simple test may note any differences between the two 
transforms. A more robust comparison may verify differ- 
ences against the values that should have been gener- 
ated by the watermarking process. 
[0023] For gray scale images, this process may be cal- 
culated separately for each element in which the water- 
mark is inserted. Watermark redundancy may be used 
to improve detection. For example, if the watermark is 
inserted in multiple elements of a color image, the 
watermarks detected in each element may be added 
together and the resulting image subjected to a detec- 
tion threshold, or the detected watermarks may be aver- 
aged and subjected to a detection threshold, or the 
detected watermarks may be combined logically, either 
logically anding them together to reduce the effects of 
noise, or logically oring them together to give a more 
robust result. Redundancy in multiple elements can also 
be used in a far more stringent form by examining all 
possibly watermarked elements together and finding a 
best fit for all elements simultaneously. Correlation tech- 
niques may also be used, as are understood in the art. 
Error control coding (ECC) techniques may be used 
during watermark generation and insertion to introduce 
redundancy for increased robustness. Redundancy 
may be improved by incorporating multiple copies of the 
watermark. 

[0024] The foregoing detailed description of the 
present invention is provided for the purpose of illustra- 
tion and is not intended to be exhaustive or to limit the 
invention to the precise embodiments disclosed. 
Accordingly the scope of the present invention is 
defined by the appended claims. 

Claims 

1. A method of embedding a watermark in a digital 
object comprising: 

applying a transform to the digital object, 
incorporating the watermark into the transform 
of the digital object by argument modulation 
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forming a marked object, and 

applying the inverse transform to the marked 

object forming the watermarked digital object. 

2. The method of Claim 1 where the step of argument 
modulation further comprises: 

selecting a set of scaling parameters, and 
applying the scaling parameters to the water- 
mark to selectively shift data in the transform of 
the digital object. 

3. The method of Claim 2 where the step of argument 
modulation further comprises: 

selecting a set of scaling parameters, and 
applying the scaling parameters to the water- 
mark to selectively shift data in the transform of 
the digital object. 

4. A computer storage medium having instructions 
stored therein for programming a computer to per- 
form the method of Claim 2. 



12. 



modulation forming a marked object, and 
compressing the marked object. 

A computer storage medium having instructions 
stored therein for programming a computer to per- 
form the method of Claim 1 1 . 



13. A method of detecting a watermark in a candidate 
digital object given the original digital object and the 

10 watermark comprising: 

applying a transform to the original object, 
applying the transform to the candidate object, 
selecting a set of scaling parameters, and 
75 correlating the differences between the two 

transforms with the watermark. 

14. A computer storage medium having instructions 
stored therein for programming a computer to per- 

20 form the method of Claim 1 3. 



5. The method of Claim 2 where the digital object is a 25 
still image. 

6. The method of Claim 2 where the digital object is a 
digital audio stream. 



7. The method of Claim 2 where the digital object is a 
stream of digital images. 



30 



8. 



The method of Claim 2 where the transform is cho- 
sen from the group of Fourier, DFT, DCT, DST, 
Walsh, Hadamard, Hartley, or Wavelet. 

A method of embedding a watermark in a digital 
object comprising: 



10. 



35 



40 



applying a transform to the digital object, 
incorporating the watermark into the transform 
of the digital object by argument modulation 
forming a marked object, 

quantizing the marked object, and 45 
compressing the quantized marked object. 

A computer storage medium having instructions 
stored therein for programming a computer to per- 
form the method of Claim 9. so 



11. A method of embedding a watermark in a digital 
object comprising: 

applying a transform to the digital object, 
quantizing the transform of the digital object, 
incorporating the watermark into the quantized 
transform of the digital object by argument 
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(57) Method of embedding a watermark in a digital 
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modulation of a transform of the object. Watermark data 
is used in the argument of the transform to effectively 
shift around values in the transform domain. 
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